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Abstract. 

The identification of the hmiting factors in the dynamical behavior of complex 
systems is an important interdisciplinary problem which often can be traced to the 
spectral properties of an underlying network. By deriving a general relation between 
the eigenvalues of weighted and unweighted networks, here I show that for a wide class 
of networks the dynamical behavior is tightly bounded by few network parameters. 
This result provides rigorous conditions for the design of networks with predefined 
dynamical properties and for the structural control of physical processes in complex 
systems. The results are illustrated using synchronization phenomena as a model 
process. 
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1. Introduction 

Complex dynamical systems are high dimensional in nature. The determination of 
simple general principles governing the behavior of such systems is an outstanding 
problem which has attracted a great deal of attention in connection with recent network 
and graph-theoretical constructs [HE]- Here I focus on synchronization, which is the 
process that has attracted most attention, and use this process to study the interplay 
between network structure and dynamics. Synchronization is a widespread phenomenon 
in distributed systems, with examples ranging from neuronal to technological networks 
[3]. Previous studies have shown that network synchronization is strongly influenced 
by the randomness [11[5], degree (connectivity) distribution ^, correlations [3 [8], and 
distributions of directions and weights [9l [10] in the underlying network of couplings. 
But what is the ultimate origin of these dependences? 

In this paper, I show that these and other important effects in the dynamics of 
complex networks are ultimately controlled by a small number of network parameters. 
For concreteness, I focus on complete synchronization of identical dynamical units 
which has served as a prime paradigm for the study of collective dynamics in complex 
networks. In this case, the synchronizability of the network is determined by the largest 
and smallest nonzero eigenvalues of the coupling (Laplacian) matrix. My principal result 
is that, for a wide class of complex networks, these eigenvalues are tightly bounded by 
simple functions of the weights and degrees in the network. The quantities involved in 
the bounds are either known by construction or can be calculated in at most 0{kN) 
operations for networks with nodes and 2kN links, whereas the numerical calculation 
of the eigenvalues of large networks would be prohibitively costly since it requires in 
general 0{N^) operations even for the special case of undirected networks. These bounds 
are in many aspects different from those known in the literature of graph spectral theory 
[T2] and are suitable to relate the physically observable structures in the network of 
couplings to the dynamics of the entire system. 

The eigenvalue bounds are then apphed to design complex networks that display 
predetermined dynamical properties and, conversely, to determine how given structural 
properties influence the network dynamics. This is achieved by exploring the fact 
that the quantities used to express the bounds have direct physical interpretation. 
This leads to conditions for the enhancement and suppression of synchronization in 
terms of physical parameters of the network. The main results also apply to a class 
of weighted and directed networks and are thus important to assess the effect of 
nonuniform connection weights in the synchronization of real- world networks The 
proposed method for network design is based on a relationship between the eigenvalues 
of a substrate network that incorporates the structural constraints imposed to the 
system and those of weighted versions of the same network. This method is thus 
complementary to other recently proposed approaches for identifying p3l [T5l [T6] or 
constructing [TH [19] networks with desired dynamical properties. 

The paper is organized as follows. In Sec. [21 I define the class of networks to be 
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considered and announce the main result on the eigenvalue bounds, which is proved 
in the appendix. In Sec. [3l I discuss an eigenvalue approach to the study of network 
synchronization. The problem of network design and the impact of the network structure 
on dynamics is considered in Sees. H] and [5l respectively. Concluding remarks are 
incorporated in the last section. 

2. Eigenvalue Bounds 

The dynamical problems considered in this paper are related to the extreme eigenvalues 
of the Laplacian matrix. This section concerns the bounds of these eigenvalues. 

2.1. Class of Networks 

Most previous studies related to network spectra and dynamics have focused on 
unweighted networks of symmetrically coupled nodes. In order to account for some 
important recent models of weighted and directed networks, here I consider a more 
general class of networks. The networks are defined by adjacency matrices A satisfying 
the condition that 

i=(|^.,), ^,J = l,...,iV, (1) 

is a symmetric matrix, where fcj > 1 is the degree of node i, factor Si = Ylj ^ij > is 
the total strength of the input connections at node i, and is the number of nodes in 
the network. According to this condition, the in- and out-degrees are equal at each node 
of the network, although the strengths of in- and out-connections are not necessarily the 
same. Matrix A = (Aij) is possibly weighted: Aij > if there is a connection between 
nodes i and j ^ i and A^ = otherwise, where Y2j Aij = ki because of the normalization 
factor Si/ki- The class of networks defined by Eq. ([1]) includes as particular cases all 
undirected networks (both unweighted and weighted) and all directed networks derived 
from undirected networks by a node-dependent rescaling of the input strengths. The 
dominant directions of the couplings are determined by Si/ki and the weights by both 
Si/ki and A, where Si/ki defines the mean and A the relative strength of the individual 
input connections at node i. The usual unweighted undirected networks correspond to 
the case where A is binary and Si = ki for all the nodes. 

The study of this class of networks is motivated by both physical and mathematical 
considerations. From the mathematical viewpoint, I show in the appendix that the 
conditions imposed to matrix A guarantee that the corresponding coupling matrices 
are diagonalizable and have real spectra. Physically, this coupling scheme is general 
enough to reproduce the weight distribution of numerous realistic networks [13j and 
to show how the combination of topology, weights, and directions affect the dynamics. 
Indeed, the weighted and directed networks comprised by the adjacency matrix A in 
([1]) include important models previously considered in the literature, such as the models 
where Si = 1 Wi, used to study coupled maps [201 EI] and to address the effects of 
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asymmetry and saturation of connection strengths [01 [ID] • It also includes the models 
introduced in Refs. [71 [221 123], where the connection strengths depend on the degrees 
of the neighboring nodes, and other models reviewed in Ref. [21]. In what follows, I 
consider the general class of networks defined by Eq. with the additional assumption 
that each network has a single connected component. 



2.2. Coupling Matrices 

The coupling matrix relevant to this study is the Laplacian matrix G = (Gij), where 

Gij = i^ijSi — Aij) . (2) 

The Laplacian matrix can be written as G = SG = SD~^L, where S = {SijSi) is the 
matrix of input strengths, G = (Lij/ki) is a normalized Laplacian matrix, D = {6ijki) 
is the matrix of degrees, and L = {6ijki — Aij). As shown in the appendix, matrices G 
and G are diagonalizable and all the eigenvalues of G and G are real. For connected 
networks where all the input strengths Si are positive, as assumed here, the eigenvalues 
of matrices G, G, and S can be ordered as 

= Ai < A2 < ■ • • < A^, (3) 

= /ii < /i2 < ■ • • < /iAT, (4) 

< z/i < z/2 < ■ ■ ■ < Z^TV, (5) 

respectively. The strict inequalities A2 > and fi2 > follow from Eq. ( ]A.7ll . which 
expresses A2 (and also 112 if one takes Si = 1 Vi) as a sum of nonnegative terms with 
at least one of them being nonzero when the network is connected. The identities 
Xi = fj'i = are a simple consequence of the zero row sum property of matrices G and 
G. 



2.3. Extreme Eigenvalues: Bounds for Arbitrary Network Structure 

I now turn to the analysis of the eigenvalues of the Laplacian matrix G. I use fcmin, ^max 
and k to denote the minimum, maximum and mean degree in the network. The minimum 
and maximum input strengths are denoted by Srain = niinj{S'i} and ^max = maxjl^j}, 
respectively, while fcmin* is used to denote the minimum degree among the nodes with 
input strength Smin- I first state the following general theorem. 

Theorem: The largest and smallest nonzero eigenvalues of matrices G, G, and S are 
related as 

l^N < Atv < UN UN, (6) 

iyiH2h < A2 < i^ig, (7) 

where h = Si)/ ^{E^h){E^k^/ Sf), g = {1 - (3)-\ and /3 = 

(krain* / Smin)/{J2i^i/ uetwork with adjaceucy matrix satisfying ([T|). 

This theorem is important because it relates the desired and usually unknown 
eigenvalues of Laplacian matrix G with the input strengths and the often approximately 
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known eigenvalues of the normalized Laplacian matrix G. In general, one has /i2 < 
N/ {N — 1) < fJ^N < 2, which follows as a simple generalization of the results in Ref. [25] 
to the weighted and directed networks defined by Eq. ([T]). Physically, the eigenvalues fj,2 
and /iTv are related to relaxation rates [10], while ui and ujy are just the input strengths 
S'min and S'max, respectively. A special case of the theorem was announced in Ref. [23] . 
The theorem is proved in the appendix. In the remaining part of the paper I explore 
applications of the theorem. 



3. Synchronization Problem 

In this section, networks of identical oscillatory systems are used to discuss how the 
coupling cost and stability of synchronous states are expressed in terms of the eigenvalues 
considered in the previous section. 



3.1. Oscillator Network 

Consider a network of N diffusively coupled dynamical units [llj modeled by 

N 

ii = F(x,)-(T5^GyH(x,), i = l,...,N, (8) 

i=i 

where the first term on the r.h.s. describes the dynamics of each unit, while the second 
equals a ^^^^ [H(xj) — H(xj)] and accounts for the couplings between different 
units: H(xj) is the signal function that describes the influence of unit j on the units 
coupled to j and cr > is the overall coupling strength. The adjacency matrix A = (Aij) 
satisfies ([1]) and is related to the Laplacian matrix G = (Gij) through Eq. ([2]). 

Completely synchronized states {xj(t) = s(t), Vi | s = F(s)} are always solutions 
of system ([8]). Since the Laplacian matrix is diagonalizable, the stability of these 
synchronous states can be studied using the standard master stability framework [11] 
(see also [El Uj). This reduces the variational equations of system ([H]) to blocks 
of the form yj = [Z}F(s) — crAjDH(s)]yj, where y2, . . . ,yAr correspond to perturbations 
transverse to the synchronization manifold. The synchronous state s is linearly stable if 
and only if the largest Lyapunov exponent A{crXi) for this equation is negative for each 
transverse mode i = 2, . . . ,N, where {Aj}^2 are the nonzero eigenvalues of G in Eq. 



3.2. Stability and Coupling Cost 

In a broad class of oscillatory dynamical systems, function A is negative in a single 
interval (ai,Q!2) [3 |10l [11]. The synchronous state is then stable for some a if the 
eigenvalues of the Laplacian matrix G satisfy the condition [5] 

R[G] ^^<^[F,H,s]. (9) 

M Oil 
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The r.h.s. of this inequahty depends only on the dynamics while the l.h.s. depends only 
on the structure of the network, as indicated in the brackets. The smaller the ratio 
of eigenvalues R the larger the number of dynamical states for which condition is 
satisfied. Moreover, when this condition is satisfied and 0:2 /ai is finite, the smaller 
the ratio R the larger the relative interval of the coupling parameter a for which the 
corresponding synchronous state is stable. 

When condition is satisfied, the eigenvalues A2 and Xn are related to the 
synchronization thresholds as 

A2 = ai/cTmin, (10) 

Aat = a2/0-max, (H) 

where cXmin and CTmax are the minimum and maximum coupling strengths for stable 
synchronization, respectively. These relations will be explored in the design of networks 
with predefined thresholds in Sec. HI 

This characterization is not complete without taking into account the cost involved 
in the coupling. The coupling cost required for stable synchronization was defined in 
Refs. pi Ho] as the sum of the coupling strengths at the lower synchronization threshold, 
C = cTminJ^ij^ij — cn/'^2 X]i '^'i- This cost fuuctiou cau be expressed in terms of 
eigenvalues of the Laplacian matrix [T7] . 

N 

C = yT,^>' (12) 

and depends separately on the dynamics (ai) and structure of the network. 

This can be used to derive an upper bound for C expressed in terms of the ratio R: 

ai{N - I) < C < ai{N - I) R. (13) 

Therefore, ratio i? is a measure of the synchronizability and cost of the network, with 
the interpretation that the network is more synchronizable and the cost is more tightly 
upper bounded when R is smaller. The synchronization problem is then reduced to the 
study of eigenvalues of the Laplacian matrix G. 



4. Design of Networks with Predefined Synchronization Thresholds 

In this section, I show how the theorem of Sec. [2] can be used to design large networks 
with predetermined eigenvalues A2 and A at. In the synchronization problem of Sec. [3l 
this corresponds to the design of networks with predetermined lower (o"min = «i/A2) 
and upper (o"max = «2/AAr) synchronization thresholds. 



Network Design 

Given an arbitrary substrate network of nodes and known eigenvalues ixn and 
/i2, the bounds in Eqs. ([6]) and ([7]) can be used to generate networks of eigenvalues 
A^r = Aat ± AAtv and A2 = A2 ± AA2, where the uncertainties AAat and AA2 depend on 
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Figure 1. (a) Illustration of the design of networks with extreme Laplacian eigenvalues 
(a) e [S*^^^, S'^a^^ X ^jv] and (b) € [S'*,i„ x ^3/1, S^^^ x g] for a given substrate 
network with normalized eigenvalues fiN and /i2. In (a), for given (Smax, the blue area 
(bottom) represents the uncertainty in Aat due to the factor fi^ and the triangular 
line (top) accounts for any inaccuracy in the determination oi fj,N- In (b), for given 
5min, the black, blue, gray and black areas (top to bottom) represent the uncertainty 
in A2 due to the factors g, ^2, h, and any inaccuracy in the determination of fi2, 
respectively. Here, g~^ and h~ are used to indicate the maximum and minimum of g 
and h, respectively, in the given interval of S'min- 



l/iAT — 1| and \g — ^2h\, respectively. Here, Aat and A2 denote the desired values and 
and A2 denote the resulting eigenvalues, which have some uncertainty. This procedure 
is illustrated in Fig. [T] and can be used to systematically design robust networks with 
tunable extreme eigenvalues. 

The rationale here is that the substrate network is chosen to incorporate topological 
constraints relevant to the problem, such as the nonexistence of links between certain 
nodes or a limit in the number of links, and that the extreme eigenvalues of the 
normalized Laplacian G of this network are calculated beforehand. Then, by adjusting 
the minimum and maximum input strengths S^i^ and S^vax, one can define new networks 
with the same topology but with the desired extreme eigenvalues for the Laplacian 
matrix G. 

More specifically, if /i at is known, one can adjust the largest input strength using 
Eq. (E]) to obtain a new network with A^ in the interval [Aat, Aat x /iat] by setting 
'S'max = S^g^^ = Aat [sec Fig. IH^a)]. Likewise, if fi2 is known, one can use Eq. ([7]) 
to adjust the minimum input strength and generate a new network with Ag within a 
desirable interval [A2 x fi2h, A2 x ^f] by taking S'min = S'^in = -^2 [see Fig. C^b)]. Naturally, 
the usefulness of this construction will depend on how close to 1 are the eigenvalue fi^ 
and H2, and how close to 1 are kept h and g as the weights are changed. The former 
condition can be justified for most networks in the usual ensembles of densely connected 
random networks and also in ensembles of sparse networks with large mean degree k [25] . 
Note that this approach can be effective even when //at and /i2 are only approximately 
known, as represented by the upper and lower black diagonal lines in Fig. [T](a) and (b). 
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Figure 2. Distribution of tlie eigenvalues (a) /i2 and (b) /ijv for Erdos-Renyi networks. 
The histrograms correspond to 3800 realizations of the networks for N = 500 and 
p = 0.2. 

respectively. The last observation is relevant precisely when fi^ and ^2 are estimated 
from an ensemble distribution or through any other probabilistic procedure. 

Importantly, because A2 is mainly controlled by S'min and A at by S'max, both 
eigenvalues can be adjusted simultaneously. In the synchronization problem, this can 
be used to define networks with predetermined synchronizability R and predetermined 
upper bound for the coupling cost C. Moreover, this construction is not unique, that 
is, there are multiple choices of the substrate network and of the assignment of weights 
{Si}fLi versus degrees {ki}fLi that will lead to the same pair of predefined eigenvalues 
A2 and Atv- This freedom can be explored to increase robustness against structural 
perturbations and to control the uncertainty by keeping h large and g small. 

4.2. Numerical Example 

Consider unweighted Erdos-Renyi networks, generated by adding with probabihty p a 
link between each pair of given nodes [26] . As shown in the histograms of Fig. [21 the 
eigenvalues fi2 and /ijv are narrowly distributed close to 1 even for relatively small and 
sparse networks. Such networks can thus be used as substrate networks to generate, 
with good accuracy, new networks of predefined eigenvalues A2 and A^r by reassigning 
the input strengths S'min and S'max, respectively. 

While a single realization of the substrate network and a deterministic assignment 
of input strengths S'min and S'max would suffice to generate the desired networks, the 
robustness of the proposed procedure becomes more visible if one considers various 
independent random constructions. For this purpose, I consider random realizations of 
the substrate network and assume that, for each such realization, the input strength of 
each node is assigned with equal probability to be either S'min or S'max- 

Figure [3] shows the numerically computed eigenvalues A2 and Xn, and the respective 
bounds, as functions of S'min and S'max- This figure is a scattered plot with 100 
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Figure 3. Design of networks with tunable eigenvalues (a) A2 and (b) A^v: the black 
lines indicate the upper and lower bounds given by Eqs. ©-(El) and the red lines 
indicate to the numerically determined eigenvalues as functions of S'min (for Smax — 1) 
and of 5'niax (for S'min = 1), respectively. Each choice of S'min in (a) and of Smax in 
(b) corresponds to 100 realizations of the substrate networks for the same parameters 
used in Fig.[2l Insets: distributions of (a) Ajv and (b) A2 for the networks used in the 
main panels (a) and (b), respectively. 



independent realizations of the substrate networks (and assignments of input strengths) 
for each choice of S'min and S^ax- As shown in the figure, except for the lower bound 
of A2, which exhibits observable dependence on the specific network realization, the 
distributions of the eigenvalues and bounds are narrower than the width of the lines 
in the figure. In addition, the numerically computed values of A2 and A^v are tightly 
bounded by the lower and upper limits in Eqs. ([6])-([7]). The difference between the 
bounds of Aat in Fig. [3](b) is thinner than the width of line. Moreover, as S'min (S'max) is 
varied for fixed S'max (S'min) in Fig-El^a) (Fig. [3](b)) , the value of A^r (A2) remains nearly 
constant, as shown in the insets. Thus, by varying both S'min and S'min, one can design 
networks where both A2 and Xn are predetermined. 

Figure HJ shows the result of such a construction for the ratio of eigenvalues R. 
Note that if all the input strengths Si are re-scaled by a common factor a, the terms 
z/tv, Xn, and VnIJ'N in Eq. ([6]) as well as the terms 2/1/12/1, A2, and Vig in Eq. ([7]) will 
change by the same factor a. Therefore, the ratio R and corresponding bounds do not 
change if, in our simulations, both Smin and Smax are re-scaled by a common factor. 

Remark: If no constraints are imposed to the topology of the network other than the 
number of nodes, then one could easily construct networks having exactly any given 
set of eigenvalues = Ai<A2<...<AAr and any given set of orthonormal eigenvectors 
Ml, ■ ■ ■ ,MAr, where = (I/a/ZV, . . . , 1/v^)- The network satisfying this conditions is 
defined by the symmetric Laplacian G = UdU'^, where d is the diagonal matrix of 
eigenvalues {Ajj^i and U is the orthogonal matrix of eigenvectors {ui}^i. Note that 
matrix G is indeed a well-defined Laplacian satisfying the zero row sum condition. 
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5. Impact of the Network Structure on Synchronization 

Equations (EI) and can be used to address the influence of the network structure on 
the dynamics. In particular, they imply that 

'S'max ^ ^ D ^ 'S'lYiax f^N 1 /i /i\ 
< ^ < -^^ T- [i-V 

Therefore, under rather general conditions, the synchronizability of the network is 
strongly limited by S'max/'S'min and Hn 1 1^2- The first ratio depends on the distribution 
of weights while the second also depends on the topology of the network. The bounds 
in Eq. (fT4l) are valid for any network satisfying condition ([T]), but are tighter for classes 
of networks with Hjsi/lJ'2, 9 and h closer to 1. In this section I focus on large random 
networks, which forms one such class of networks. 



5.1. Synchronizability of Random Networks 

For concreteness, consider random networks for which the normalized matrix A is 
unweighted. That is, random networks which are either unweighted or whose weights are 
factored out completely in Eq. ([T]). For these networks, one can invoke the known result 
from graph spectral theory [25j that the expected values of the extreme eigenvalues of 
G approach 1 as (/iat) = 1 + 0{1/Vk) and (/i2) = 1 — 0(1/ y/k) for large mean degree k. 
This behavior has been shown to remain valid for networks with quite general expected 
degree sequence [27] and to be consistent with numerical simulations on various models 
of growing and scale-free networks [Qj [10] , even when the networks are relatively small 
and only approximately random insofar as k^[^ ^1. In addition, the distribution of 
the eigenvalues across the ensemble of random networks becomes increasingly peaked 
around the expected values as the size of the networks increases [27t [28] . Furthermore, 
for most realistic networks, h is bounded away from zero and 9 approaches 1 for large N 
[it can be replaced by 1 if the conditions in remark 1 (appendix) apply]. For unweighted 
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networks, in particular, h = {kk~^)~^/'^ and g = N/{N — 1), where is the average 
of 1/ki in the network. Therefore, for a wide class of complex networks, the eigenvalues 
Aat and A2 are mainly determined by 5'max, through S'max < Aat < S'max/iAf, and by S'min, 
through S'inin/i2^ < A2 < Spaing, respectively. 

In the case of unweighted (and undirected) networks, the input strengths are 
determined by the degrees of the nodes and 5'max/ 'S'min = ^max/ ^min- Thus, the bounds in 
Eq. ([T^ can be used to assess the effect of the degree distribution. As a specific example, 
consider random scale-free networks [29l [30] with degree distribution = ck,~'^ for 
> ^min and 7 > 2, where 1/c = "^^Zj^^.^ ~ f^mln^/ (7 — 1) is a normalization factor. 
From the condition P{K)dK = 1 [31], one has /cmax/^min ~ N^/i"/-^)^ which leads 

to 

for large N and k^in [32]. This simple scaling for the expected value of R explains 
the counter-intuitive results about the suppression of synchronizability in networks 
with heterogeneous distribution of degrees reported in Ref. [6]. Random scale-free 
networks were found to become less synchronizable as the scaling exponent 7 is reduced, 
despite the concomitant reduction of the average distance between nodes [33] that 
could facilitate the communication between the synchronizing units [6]. Equation ( IT^ 
shows that this effect of the degree distribution is a direct consequence of the increase 
in the heterogeneity of the input strengths, characterized by S'max/'S'min = fcmax/^min- 
Equation f|T5l) predicts this effect as a function of both the scaling exponent 7 and the 
size N of the network. In particular, this equation shows that scale-free networks become 
more difficult to synchronize as increases and this is again because S'max/'S'min ~ 
jYi/(7-i) increases. On the other hand, synchronizability increases as 7 is increased and 
becomes independent of the system size for 7 = 00, indicating that networks with the 
same degree for all the nodes are the most synchronizable random unweighted networks 
(see also Ref. [3l]). 

In the more general case of weighted networks, the input strengths are not 
necessarily related to the degrees of the nodes. An important implication of Eq. (IT^ 
is that, given a heterogeneous distribution of input strengths Si in Eq. ([T]), the 
synchronizability of the network is to some extent independent of the way the input 
strengths are assigned to the nodes of the network, rendering essentially the same 
result whether this distribution is correlated or not with the degree distribution. In 
both cases, synchronizability is mainly determined by the heterogeneity of the input 
strengths S'max/'S'min and the mean degree k. In particular, synchronizability tends to be 
enhanced (suppressed) when the mean degree k is increased (reduced) and when the ratio 
'S'max/ 'S'min is rcduccd (iucreascd). This raises the interesting possibility of controlling the 
synchronizability of the network by adjusting these two parameters, which was partially 
explored in Sec. HI 
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5.2. Structural Control of the Dynamics 

As a specific example of control, consider a given random network with arbitrary input 
strengths {Si}fLi, where the topology of the network is kept fixed and the input strengths 
are redefined as 

sm = is,y, (16) 

with 6 regarded as a tunable (control) parameter. For large k, synchronizability is now 
mainly determined by ma.Xij{Sl{9) / Sj{9)} = {Smax/ SmmY ■ Within this approximation, 
synchronizability is expected to reach its maximum around 6 = 0, quite independently 
of the initial distribution of input strengths Si and the details of the degree distribution. 
This generalizes a result first announced in Ref. [9], namely that networks with good 
synchronization properties tend to be at least approximately uniform with respect to 
the strength of the input signal received by each node (but see remark below). 

These optimal networks have interesting properties. For ^ = 0, all the nodes of the 
network have exactly the same input strength. Thus, if nodes i and j are connected, the 
strength of the connection from j to i scales as l//cj, while the strength of the connection 
from i to j scales as l/kj. This indicates that, unless all the nodes have exactly the 
same degree, the networks that optimize synchronizability for that degree distribution 
are necessarily weighted and directed. Moreover, if kj > ki, the strength oc 1/ki of 
connection from node j to node i is larger than the strength oc l/kj of the connection 
from node i to node j. Therefore, in the most synchronizable networks, the dynamical 
units are asymmetrically coupled and the stronger direction of the connections is from 
the nodes with higher degrees to the nodes with lower degrees. The asymmetry and 
the predominance of connections from higher to lower degree nodes is a consequence 
of the condition that nodes with different degrees have the same input strength, a 
condition that introduces correlations between the weights of individual connections and 
the topology of the network and that has been observed to have similar consequences 
in other coupling models [71 El]. These results combined with the interesting recent 
work of Giuraniuc et al. [35] on critical behavior suggest that, in realistic systems, the 
properties of individual connections are at least partially shaped by the topology of the 
network. 

Remark: The above analysis shows that for the networks satisfying the condition in 
Eq. ([T]), i? is more tightly bounded close to the optimal value R = 1 when the distribution 
of input strengths Si is more homogeneous. Indeed, the bounds in Eq. ([T^ leave httle 
room for the improvement of synchronizability by changing the weights of individual 
links or the way the nodes are connected if S'max/ •S'min is not reduced. For classes of more 
general directed networks, however, one can have highly synchronizable networks with 
a heterogeneous distribution of Si. To see this, consider the set of most synchronizable 
networks among all possible networks, which is precisely the set of networks with R = 1 
and eigenvalues A2 = • ■ ■ Aat = A > 0. As shown in Refs. [TH [IT], if the Laplacian 
matrix G is diagonalizable, then the networks with R = 1 are those where each node 
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either has output connections with the same strength to all the other nodes (and at 
least one node does so) or has no output connections at all. From this and the zero 
row sum property of the Laplacian matrix, it follows that Si = '^j^i aj = X — ai, where 
> is the strength of each output connection from node i. Accordingly, the input 
strength Si is upper bounded by A, but not necessarily the same for all the nodes. In 
particular, since the strengths of the output connections can have any values > (as 
long as at least one is non-zero), in this case there is no lower limit for Si and the ratio 
Sma.x/ Smin cau bc arbitrarily large despite the fact that _R = 1. Therefore, even when 
the spectra is real, strictly directed networks can be fundamentally different from the 
directed networks considered here [36] . 

6. Concluding Remarks 

I have presented rigorous results showing that the extreme eigenvalues of the Laplacian 
matrix of many complex networks are bounded by the node degrees and input strengths, 
where the latter can be interpreted as the weighted in-degrees in the networks. These 
results can be used to predict and control the coupling cost and a number of implications 
of the network structure on the dynamical properties of the system, such as its tendency 
to sustain synchronized behavior. I have shown here that these results can also be used 
to design networks with predefined dynamical properties. 

While I have focused on complete synchronization of identical units, the leading 
role of Smax/ Smin and k revealed in this work also provides insights into other forms 
of synchronization. In particular, it seems to help explain: the suppressive effects of 
heterogeneity in the synchronization of pulse-coupled [3^ and non-identical oscillators 
[7j; the dominant effect of the mean degree in the synchronization of time-delay 
systems with normalized input signal [3H]; and the dominant effect of the degree in 
the synchronization of homogeneous networks of bursting neurons [39] . The scale-free 
model of neuronal networks considered in Ref. [ID], which was shown to generate large 
synchronous firing peaks, is also consistent with (an extrapolation of) the results above. 
Indeed, the networks in that model are scale free only with respect to the out-degree 
distribution and are homogeneous with respect to the in-degree distribution. Therefore, 
the results presented here may serve as a reference in the study of more general systems, 
including those with heterogeneous dynamical units [H] 1121 SSI HH HH] • In general, the 
impact of the network structure will change both with the specific synchronization model 
and with the specific question under consideration, and an important open problem is 
to understand how it changes. 

Finally, since the Laplacian eigenvalues also govern a variety of other processes 
[l6l HT] , including the relaxation time in diffusion dynamics [lO] , community formation 
[H], consensus phenomena [l9], and first-passage time in random walk processes [50] . 
the results reported here are also expected to meet other applications in the broad area 
of dynamics on complex networks, particularly in connection with network design in 
communication and transport problems. 
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Appendix. Proof of the Theorem 

In what follows 1 use the notation that, if X is a iV x matrix with eigenvalues 
tti < tt2 < • ■ ■ < o^N, then vf denotes a normalized eigenvector of eigenvalue a^. The 
proof of the theorem is divided in 6 steps. 

Step 1: The eigenvalues of matrices G and G satisfy 

eig(G)=eig(if), (A.l) 

eig(G)=eig(Q), (A.2) 

where H = D-^/^LD-^/^ and Q = S^I^HS^^^. Equations (lATD and flA2l) follow from 
the identities det(G' — al) = det{H — al) and det{G — al) = det(Q — a/), respectively, 
where a is an arbitrary number and I is the N x N identity matrix. Because matrices 
H and Q are symmetric, their eigenvalues are real, as assumed in Eqs. ([3]) and (jl]), and 
the corresponding eigenvectors can be chosen to form orthonormal bases [51j . 

Step 2: The diagonalizability of matrices G and G, a condition invoked in the rest of this 
appendix, can be demonstrated as follows. Matrix Q is symmetric and hence has a set of 
orthonormal eigenvectors {vf}fLi. Then, from the identity G = S^^'^D~^^'^QS~^^'^D^/'^, 
and the fact that S^^'^D~^^'^ is nonsingular, it follows that {S^^^ D^^^'^v^}'^Li forms a 
set of N linearly independent eigenvectors of G. This implies that G is diagonalizable. 
From the special case S = I, it follows that the same holds true for G. 

Step 3: The upper bound of A at in Eq. ([6]) follows immediately from 

Aat = max II^Gf II < max H^f || max \\Gv\\ (A. 3) 

where ||.|| is the usual Euclidean norm. 

Step 4'- The lower bound of A at in Eq. ([6]) is derived from 

Xn = max \\Gv\\ > \\Gv\\, (A.4) 

||t;||=l 

where w is a unit vector chosen such that Vi = and j{N) is the index of a node 

with the largest input strength. Equation ( 1A.4I) leads to 



A^ > 'S'j(jv) + ^ ^ij(Ar)('S'i/fcj)^) (^-5) 
i 

and this leads to the lower bound in Eq. ([6]) with a strict inequality for finite size 
networks. In the particular case of unweighted networks, Eq. (lA.SP implies A^r > 
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Step 5: Now I turn to the upper bound of A2 in Eq. From the identity eig(G') 
eig{Q), one has 

{v,Qv) 



mm 



\\v\\j^O \ v±vf {V,V) 

where (., .) denotes the usual scalar product. This equation can be rewritten as 



X2 = ^{kj/Sj) min 



Aij{^Si/kiVi - ^/Sj/k 



where I have used that v'^ oc (a/A^i/^S'i, ■ ■ ■ , \/kN/ Sn) to obtain the identities 



(A.6) 



(A.7) 



^Aij{^/Si/kiVi - ^JSj/kjVjf = 2{v^,Qv^), 



where is the component of v orthogonal to v*^ . The minimum in Eq. (\A.7\i can be 
upper-bounded by taking Vi = where is the index of a node with the smallest 
input strength, and this leads to the upper bound in Eq. ([71). 

Remark 1: A different bound, A2 < {S'^'kj" + Sj„kj/ + 2Ajrj»Sj'Sj")/ {Sj'kj" + Sj/rkjr), is 
obtained for any j" ^ j' by using Vi — Sj' j kj/Siji — ^/ S jn / kjudijn to upper-bound A2 
in Eq. flA.6l) . This leads to A2 < vi if there are two nodes with minimum input strength 
Sinin that are not connected to each other. 

Remark 2: Alternatively, one can show that eig(G') = eig{H^^'^SH^^'^) and use this to 
upper-bound A2 with ||if^/^S'if^''^f for V-Lv^ in the span of {ff,ff}. If there are 



two or more nodes with minimum input strength S'min, then it follows from this bound 
that A2 < i^ifJ'N- 



Step 6: The lower bound of A2 in Eq. (jT]) is derived as follows. From the identity 
eig(G) = eig(Q), one has 



A2 = min \\Qv\ 

\\v\\=l \ vLu^ 



min \\S^'^HS^'^v\\. 

\\v\\=l I t;±S-i/2„H 



The identity 



11^1/2^^1/2^1 



H-. 



(A.8) 



\HSy^v\ 

and the observation that the minimum of the product is lower-bounded by the product 
of the minimums lead to 

Sv 



A2 > ^1 min 

IIdIIt^O I v±v^ 



H- 



\Sv\ 



> Z/i/i2||f 



(A.9) 
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where 



In the r.h.s. of Eq. (lA.lOp one has the maximum of function \{Sv,v^)\'^ under the 
constraints {v,Vi) = and ||5'f || = 1, which can be determined using the Lagrange 
Multiphers Method with two multiphers. The resuhing set of equations is 

J2^iV, = 0, (A.ll) 

i 

J2SM =1, (A. 12) 

i 

\ — ! = mi— =^ + 17128} Vi, (A.13) 
VkN VkN 

where rui and m2 are the Lagrange Multiphers. This system of equations can be solved 
for 1712 = max | {Sv, v^) \ under the corresponding constraints by taking of Eq. (lA.lSP 
multiplied by fj, \fkij Si^ and \/ki/Sf, respectively. The result is 

^2 _ -, {Y^i^ilSif (^^A\ 
(E.i.)(E.*,/s?)- 

The lower bound in Eq. ([7]) follows from Eqs. f[0|) . f[O0|) . and f[04l) . and this 
concludes the proof of the theorem. □ 
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